The Thermodynamic Limit in Mean Field 
Spin Glass Models 



Francesco Guerra* 

Dipartimento di Fisica, Universitd di Roma 'La Sapienza' 
and INFN, Sezione di Roma, Piazzale A. Moro 2, 00185 Roma, Italy 

Fabio Lucio Toninelli^ 

Scuola Normale Superiore, Piazza dei Cavalieri 7, 56126 Pisa, Italy 
and Istituto Nazionale di Fisica Nucleare, Sezione di Pisa 

February 1, 2008 

Abstract 

We present a simple strategy in order to show the existence and 
uniqueness of the infinite volume limit of thermodynamic quantities, 
for a large class of mean field disordered models, as for example the 
Sherrington-Kirkpatrick model, and the Derrida p-spin model. The 
main argument is based on a smooth interpolation between a large 
system, made of N spin sites, and two similar but independent subsys- 
tems, made of N\ and N2 sites, respectively, with N\ + N2 = N. The 
quenched average of the free energy turns out to be subadditive with 
respect to the size of the system. This gives immediately convergence 
of the free energy per site, in the infinite volume limit. Moreover, a 
simple argument, based on concentration of measure, gives the almost 
sure convergence, with respect to the external noise. Similar results 
hold also for the ground state energy per site. 
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1 Introduction 



The main objective of this paper is to propose a general strategy in order to 
control the infinite volume limit of thermodynamic quantities for a class of 
mean field spin glass models. For the sake of definiteness, we consider firstly 
in full detail the Sherrington-Kirkpatrick (SK) model, ||], 0. Then, we show 
how to generalize our method to similar related mean field disordered models, 
as for example the Derrida p-spin model, @, @. 

It is very well known that the rigorous control of the infinite volume 
limit for these mean field models is very difficult, due to the effects of very 
large fluctuations produced by the external noise. In particular, it is very 
difficult to produce very effective trial states, to be exploited in variational 
principles. It is only for the high temperature, or high external field, regime 
that a satisfactory control can be reached, as shown for example in ||, ||, 

We will introduce a very simple strategy for the control of the infinite vol- 
ume limit. The main idea is to split a large system, made of N spin sites, into 
two subsystems, made of Ni and N 2 sites, respectively, where each subsys- 
tem is subject to some external noise, similar but independent from the noise 
acting on the large system. By a smooth interpolation between the system 
and the subsystems, we will show subadditivity of the quenched average of 
the free energy, with respect to the size of the system, and, therefore, obtain 
a complete control of the infinite volume limit. 

Moreover, the well known self averaging of the free energy density, as 
shown originally by Pastur and Shcherbina in M , extended to the estimates 



given by the concentration of measure, as explained in |§ and fL0| , does allow 
an even more detailed control of the limit. In effect, it will turn out that the 
free energy per site, without quenched average, converges almost surely, with 
respect to the external noise. These results extend to other thermodynamic 
quantities, in particular to the ground state energy per site, as it will be 
shown in the paper. 

The organization of the paper is as follows. In Section 2 we recall the 
general structure of the Sherrington-Kirkpatrick mean field spin glass model, 
in order to define the main quantities, and fix the notations. Next Section 3 
contains the main results of the paper, related to the control of the infinite 
volume limit. In Section 4 we show how to extend our results to other mean 
field spin glass models, in particular to the Derrida p-spin model and to 
models with non-Gaussian couplings. Section 5 contains conclusions and 
outlook for future developments and extensions. 
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2 The structure of the Sherrington-Kirkpatrick 
model 



Let us recall some basic definitions. 

Ising spin variables oi = ±1, attached to each site i = 1, 2, . . . , N, define 
the generic configuration of the mean field spin glass model. The external 
quenched disorder is given by the N(N — l)/2 independent and identical 
distributed random variables Jy, defined for each couple of sites. For the 
sake of simplicity, we assume each to be a centered unit Gaussian with 
averages 

E(J l3 )=0, E(4) = l. 

The Hamiltonian of the model, in some external field of strength h, is given 
by 

1 N 
H N (a,h,J) = — -= ^2 JijO-iOTj - h^o-i. (1) 

* l<i<j<N 1=1 

The first term in (p]) is a long range random two body interaction, while the 
second represents the interaction of the spins with a fixed external magnetic 
field h. 

For a given inverse temperature (3, we introduce the disorder dependent 
partition function Z N (j3, h, J), the quenched average of the free energy per 
site /jv(/3,/i), the Boltzmann state u>j, and the auxiliary function aN(/3,h), 
according to the definitions 

Z N (P, h,J) = J2 eM-PH N (a, h, J)), (2) 
M 

-Pf N (P, h) = N- X E log Z N (P, h, J) = a N (P, h), (3) 

ujj(A) = Z N (P, h, J)' 1 J2 Ae M-PH N (a, h, J)), (4) 

where A is a generic function of the cr's. In the notation uj, we have stressed 
the dependence of the Boltzmann state on the external noise J, but, of course, 
there is also a dependence on /3, h and N. 

Let us now introduce the important concept of replicas. Consider a 
generic number s of independent copies of the system, characterized by the 
Boltzmann variables af \ af \ . . ., distributed according to the product state 

O - , .M, ,(2) , ,« 

where all uj^f 1 act on each one cr^'s, and are subject to the same sample J 
of the external noise. Clearly, the Boltzmannfaktor for the replicated system 
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is given by 

exp (-P(H N (a m ,h, J) + H N (a {2 \h, J) + . . . + H N (a {s \h, J))) . (5) 
The overlaps between any two replicas a, b are defined according to 

i 

and they satisfy the obvious bounds 

-1 < q ab < 1. 

For a generic smooth function F of the overlaps, we define the () averages 

(F(q 12 ,q 13 ,...)) = E£lj(F(q 12 ,q 13 , ...)), 

where the Boltzmann averages Qj acts on the replicated a variables, and E 
is the average with respect to the external noise J. 

3 Control of the infinite volume limit 

Let us explain the main idea behind our method. We divide the N sites into 
two blocks Ni, N 2 with N x + N 2 = N, and define 

Z N(t) = J2 ex V\Nji 3i i 0i °i +I3 V~N~ Yl J 'ij a i a i ( 6 ) 

M V l<i<j<N V 1 l<i<j<Ni 

+p J Y J ii a ^j ) ex p P h Y a » 

' 2 Ni<i<j<N / i=l 

with < t < 1. 

The external noise is represented by the independent families of unit Gaus- 
sian random variables J, J' and J". Notice that the two subsystems are sub- 
ject to a different external noise, with respect to the original system. But, of 
course, the probability distributions are the same. The parameter t allows 
to interpolate between the original iV spin system at t — 1 and a system 
composed of two non interacting parts at t — 0, so that 

Z N (l) = Z N ((3,h,J) (7) 
Z N (0) = Z Nl ((3, h, J')Z N2 ((3, h, J"). (8) 
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As a consequence, by taking into account the definition in (|3]), we have 

E\nZ N (l) = Na N (P,h) (9) 
ElnZ N (0) = N iaNl (/3,h) + N 2 a N2 ((3,h). (10) 

By taking the derivative of N~ l E In Zjv(i) with respect to the parameter t, 
we obtain 

±L T E\nZ N (t) = i-E\^= V J^ t (a^) ill: 



\ v tiv l<i<j<N 



'y/{l-t)N ll 



dtN' 

<i<j<Nr VI 1 r / iV 2 Nt<i<j<N / 

where o>t(.) denotes the Gibbs state corresponding to the partition function 
@. A standard integration by parts on the Gaussian noise, as done for 
example in [Q], ||TTf , gives 

H 1 tf 2 - tf 2 Wl 

dtN W 4iV 2 ^ V n ANNi ^ V tl J/; 

i,j=i i,j=i 

/? 2 * 

-ilk E ^—K^)) (12) 

= -T^-^^'-f^')- (13) 

where we have defined 

iVi 

*i = ( 14 ) 

i=i 

N 

N 2 q?j= ( 15 ) 

i=Ni+l 

Since gi2 is a convex linear combination of and gj^ m the form 

Nl (1) iV 2 (2) 

due to convexity of the function / : x — > x 2 , we have the inequality 



Therefore, we can state our first preliminary result. 



5 



Lemma 1. The quenched average of the logarithm of the interpolating par- 
tition function, defined by (|6[) ; is increasing in t, i.e. 

^ElnZ N (t)> . (16) 

By integrating in t and recalling the boundary conditions (||), we get the 
first main result. 

Theorem 1. The following superadditivity property holds 

Na N ((3,h) > Nxa Nl (P,h) + N 2 a N2 ((3,h). (17) 

Of course, due the minus sign in (Qj, we have subadditivity for the quenched 
average of the free energy. 

The subadditivity property gives an immediate control on the infinite 
volume limit, as explained for example in [0. In fact, we have 

Theorem 2. The infinite volume limit for aN{(3,h) does exists and equals 
its sup 

lim a^iP, h) = sup «at(/5, h) = a(/3, h). (18) 

TV— >oo 

For finite N and a given realization J of the disorder, define the ground 
state energy density —e^iJyh) as 

-e N (J,h) = ±-mfH N (a,h,J). (19) 

iV <T 



Now we show, from simple thermodynamic properties, that Eq. (jig) 
implies the existence of the thermodynamic limit for E (ejv(/i, J)). First of 
all, notice that the bounds 

e f3Ne N (J,h) < ^2 e -PH N (a,h,J) <- 2 ^ e /3Ne N (J,h) ^0) 

M 

hold for any J, N, (3, h, so that 

\nZ N (p,h,J) ln2 
0< m e N Uh)<—. (21) 



The bounds (|2lD , together with the obvious 

\nZ N (/3,h,J) 
dp ^ < 0, 
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imply that 



\nZ N (P,h, J) 

i im m ^ eiV ( J ' h >- ( 22 ) 

(3— too jjrs 



Of course, by taking the expectation value in ([H]) and defining 

e N (h) = Ee N (J, h), 

one also finds 

}™^^ ieN{h) - (23) 



Therefore, by taking into account the superadditivity fllTD, the inequalities 
(|2l|) , and the existence of the limit h) for a^iP, h), we have from (|23| ) 
the proof of the following 

Theorem 3. For the quenched average of the ground state energy we have 
the subadditivity property 

Ne N {h) > N ieNl (h) + N 2 e N2 (h). (24) 

and the existence of the infinite volume limit 

lim eiv(/i) = supejv(/i) = eo(h). (25) 

N— »oc TV 

Finally, we can write the limit e (h) in terms of a(j3,h) as 

lim I e Q (h). (26) 

After proving the existence of the thermodynamic limit for the quenched 
averages, we can easily extend our results to prove that convergence holds 
for almost every disorder realization J. In fact, we can state 

Theorem 4. The infinite volume limits 

lim ±-]nZ N (/3,h,J) = a(l3,h), (27) 

N— >oo iv 



lim e N (J,h) = e {h), (28) 

N^oo 



do exist J -almost surely. 
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For the proof, we notice that the fluctuations of the free energy per site 
vanish exponentially fast as iV grows, a result strengthening the pioneering 
quadratic selfaveraging proven in M. Indeed, the following result holds |9J 



P 



1 



\nZ N ((3, h, J) - —E In Zn(P, h, J) 



> u < e 



-Nu 2 /2 



(29) 



(3N ' ' (3N 

Since the r.h.s. of (p9|) is summable in N for every fixed u, Borel-Cantelli 



lemma |13|, and the convergence given by (|18|) imply (|27|) . The same argu- 
ment can be exploited for the ground state energy In fact, by taking the 
P — > oo limit in (p9|) , we get 



P(\e N (J,h)-e N (h)\ >u)< e- Nu2/2 . 



(30) 



Again, Borel-Cantelli lemma implies (p8|), and the Theorem is proven. 

Notice that all the results of this Section hold also in the case where on 
each spin <7j acts a random magnetic field hi, where the h^s are i.i.d. random 
variables. 



4 Existence of the thermodynamic limit for 
other mean field spin glass models 

In this Section, we show how the above results on the (almost sure) existence 
of the thermodynamic limit for the free energy and for the ground state 
energy can be extended to other mean field spin glass models. In the first 
place, we can immediately extend the approach to p-spin models, for even 
p. On the other hand, we can allow the quenched disorder variables to be 
non-Gaussian, provided that suitable bounds are imposed on their moments. 



4.1 £>-spin models 

The p-spin model is defined by the Hamiltonian 



(ii,—,i P ) i 

where p is an integer and Ji x ...% v are i.i.d. unit Gaussian random variables. 
The summation in the first term is performed on all the different p-ples of 
indices i±, . . . ,i p . Note that for p = 2 this is just the SK model. The p- 
spin model has been proposed by Derrida in 0, and extensively studied 
thereafter, see for example [Q, @, ]H| , P> . 
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For the sake of simplicity, we consider the case of even p. As we did for 
the SK model, we define the auxiliary partition function Z^(t), in analogy 
with (|B|). By taking the t derivative, we find after integration by parts 

~E \nZ N {t) = (q{ 2 - ^(q$y - ^(gg>)^ + 0(1/N) (32) 
> 0(1/N), 

for p even, by the same convexity argument as before. It is easy to realize 
the reason for the appearance of the terms 0(1/N). In fact, for p = 2, we 
can write 

2 1 - 

— X> (1 - ufaiVj)) = J^J2 E ( 1 ~ = C 1 - (33) 



as already exploited in fll2). On the other hand, for p > 2 one has 

£ E(1-^ 2 K...^)) = — E(l-^(a k ...a ip )) + 0(l/N) 



= (l-(?? 2 »+O(l/A0- (34) 

From (|32| ) one finds, as in the previous Section, the existence of the infinite 
volume limits 

lim a$(J3,h) = a ip) {(3,h) (35) 
lim e%\h) = <$\h) = lim (36) 

iv— >oo fj— too jj 

Moreover, the estimate (|29"D holds also in this case, since it is based only 
on the fact that l/N/3 In Z^((3, h, J), as a function of the variables J, has a 
Lipshitz constant of order C / VN, where C is a constant independent of (3 
||. Therefore, also in this case we have almost sure convergence for the free 
energy and for the ground state energy. 



4.2 Non-Gaussian couplings 

The method developed in the previous Sections allows to prove the existence 
of the thermodynamic limit for ajv(/3, /i) and for e^ih) also for SK (or p- 
spin) models with non-Gaussian couplings, provided that the variables Jij 
(respectively, J^,...^ ) are i.i.d. symmetric random variables with finite fourth 
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moment, i.e., P{J%j) = P(—Jij) and Ejfj < oo. A similar condition has 
been also exploited for the study of the model, at zero external field and 
high temperature, see for example [16] and [I7|. Consider for instance the 



SK case. The integration by parts on the disorder variables in ([LI]) can be 
performed by use of the formula 



E r]F(r}) = E r] 2 F'(r]) - \e f* {rf - t 2 )F"'{t) dt, (37) 

4 J-\v\ 



which holds for any symmetric random variable 77 and for sufficiently regular 
functions F, as a simple direct calculation shows. A similar expression has 
been exploited by Talagrand in Hl8| , for dicotomic variables. By applying 
this formula to the various terms in (IT1T), one finds that 



l„Z„( f ) = -££. (& - - ^S?) + 0(N-"% (38) 

where 

J 2 = EJ*. 
The error terms arise from the estimates 

d%co t (a t a 3 ) = 0{N-^) 

and 

E Jfjufaw) = J^Eufricrj) + 0{N- 1 ' 2 ). 

The existence of the thermodynamic limit for the quenched averages of the 
free energy and the ground state energy then follows. 

In order to prove J-almost sure convergence, for the sake of simplicity, 
let us consider the case where the random variables are bounded. Then, 
the estimate (p9|) still holds, with the r.h.s. modified into exp(— N Ku 2 ), 
where K does not depend on (3. This can be proved, for instance, by using 
Theorem 6.6 of [pjj. Almost sure convergence for the free energy and for the 
ground state energy then follows immediately from Borel-Cantelli lemma. 
In particular, this includes the important case where J^- = ±1 with equal 
probability. The extension to more general cases, where only the condition 
EJf; < 00 is required, is possible, and will be reported in future work. 

5 Conclusions and outlook 

We have seen that the rigorous control of the infinite volume limit for mean 
field spin glass models can be obtained through a simple strategy, by a smooth 
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interpolation between a large system and its splitting into subsystems, pro- 
vided the external noises are taken independent. 

The extension of our methods to the important cases of diluted models, 
and other models of the neural network type, will be taken into account in 
future work. 
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